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Foreword 


This  publication  of  systemwide  performance  indicators  is  both  an  ending  point  and  a  starting 
point  for  the  Boston  Public  Schools.  For  those  who  have  worked  so  conscientiously  over  the 
past  few  years  to  promote  the  concept  of  accountability  and  to  those  who  have  worked  so 
diligendy,  particularly  members  of  the  Boston  Compact  Measurement  Committee,  to  identify 
performance  indicators,  this  report  is  an  acknowledgement  of  their  contribution  to  the  school 
community.  While  there  will  be  ongoing  refinements  to  the  set  of  performance  indicators  and 
reponing  procedures,  this  report  marks  the  end  of  the  initial  development  phase  of  the 
accountability  system.  At  the  same  time,  this  publication  marks  the  beginning  of  a  yearly 
pubUc  reporting  process  whereby  members  of  the  broad  Boston  Public  Schools  community 
will  have  the  opportunity  to  leam  how  the  system  has  done  in  the  previous  year  on  a  variety  of 
indicators.  In  conjunction  with  their  individual  school  End-of-Year  reports,  administrators  and 
teachers  will  have  the  responsibility  to  act  upon  the  information  contained  in  this  report  to 
ensure  the  best  possible  education  for  the  nearly  60,000  students  enrolled  in  the  Boston  Public 
Schools. 

We  look  forward  to  your  comments  and  suggestions  about  both  the  format  and  the  content  of 
this  report. 


Superintendent 
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Executive   Summary 

This  report  summarizes  the  current  status  and  progress  of  the  Boston  Public  Schools  during  the 
1991-92  school  year  in  terms  of  nineteen  Performance  Indicators.  In  conjunction  with 
contractual  agreements  with  the  Boston  Teachers'  Union,  these  indicators  were  identified  by 
the  Boston  Compact  Measurement  Committee  and  accepted  by  the  Superintendent  and  the  Zone 
Superintendents  as  a  means  to  provide  a  more  comprehensive  description  of  the  status  of 
individual  schools  and  the  school  system  as  a  whole.  By  providing  this  information  to  the 
Boston  School  community,  all  members  of  the  education  community  will  be  able  to  use  this 
information  to  promote  school  improvement.  The  indicators  were  examined  in  clusters  as  well 
as  individually  both  for  changes  during  the  past  year  and  for  trends  during  the  past  three  years. 
Major  findings  are  listed  below. 

Elementary  School  Level 

School   Holding  Power/Climate 

Overall,  elementary  schools  have  greater  holding  power  during  the  1991-92  school  year 
as  indicated  most  strongly  by  increases  in  school  choices  and  decreases  in  student 
suspensions. 

•  Student  Achievement 

Some  improvements  in  student  achievement  were  observed,  particularly  in  the  area  of 
Mathematics  achievement.  Fewer  students  scored  below  average  and  more  students 
scored  above  average  in  mathematics.  For  both  Reading  and  Madiematics,  at  all  grade 
levels  the  median  percentiles  were  at  or  above  the  national  average. 

•  School   Involvement  Practices 

Efforts  to  involve  Special  Education  students  and  Bilingual  Education  students  more  fully 
in  the  regular  education  classroom  were  observed  in  positive  changes  in  Special 
Education  prototypes  and  Bilingual  Education  Lau  Step  classifications. 
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Middle  School  Level 

School   Holding   Power/Climate 

Across  all  five  indicators,  middle  schools  were  shown  to  have  greater  holding  power  in 
SY 199 1-92  than  in  the  previous  school  year.    School  Choice  and  dropouts  were  the 
indicators  with  the  greatest  change  during  this  interval. 
•       Student  Achievement 

Changes  in  student  achievement  were  somewhat  uneven  at  the  middle  school  level.  Some 
improvements  were  found  in  mathematics  achievement  but  generally  there  were  small 
losses  in  reading  achievement  during  this  time  period.  In  terms  of  the  median  percentiles, 
in  Reading,  each  of  the  middle  school  grades  was  one  or  two  percentile  points  below  the 
national  average  and  for  Mathematics,  each  grade  level  was  above  the  national  average. 

School   Involvement  Practices 

Generally  the  indicators  show  improvements  in  mainstreaming  efforts  at  the  middle 
school  level.  In  particular,  there  was  a  large  decrease  in  the  number  of  new  referrals  to 
Special  Education.  However,  among  students  aheady  in  Special  Education,  students 
were  more  likely  to  move  into  a  more  restrictive  setting  during  SY  199 1-92  than  in  the 
previous  year,  SY1990-91. 

High  School  Level 

School  Holding  Power/Climate 

Evidence  for  increased  holding  power  at  the  high  school  level  was  observed  in  the  areas 
of  decreased  dropouts  and  increased  school  choice.  Student  suspensions  were  an  area 
where  improvement  did  not  occur  during  the  past  year. 

Student  Achievement 

Except  for  the  ninth  grade  in  Reading  and  Mathematics,  performance  remained  constant 
or  improved.  Relative  to  the  national  average,  in  both  Reading  and  Mathematics  the  ninth 
grade  is  at  or  above  the  national  average  and  the  twelfth  grade  performance  in 
Mathematics  is  above  the  national  average. 

School  Involvement  Practices 

High  schools  generally  made  considerable  gains  in  increasing  the  involvement  of  Special 
Education  and  Bilingual  Education  students  in  mainstream  settings.  This  was 
particularly  evident  in  the  Lau  Step  increases  among  Bihngual  Education  students. 
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Comparison  with  Other  School  Systems 

•  Using  a  report  published  by  the  Council  of  the  Great  City  Schools,  scores  on  the 
Metropohtan  Achievement  Test  (MAT6)  for  SY 1990-91  were  compared  to  those  from 
three  other  urban  school  systems  which  also  use  the  MAT6.  Boston  students' 
performance  was  substantially  better  than  that  of  two  of  the  districts  in  both  Reading  and 
Mathematics.  It  was  similar  to  the  third  district  in  Mathematics. 

The  data  from  the  performance  indicators  indicate  that  the  majority  of  the  Boston  PubUc 
Schools  are  making  advances  in  core  areas.  The  size  of  the  changes  may  not  always  be  large, 
and  some  areas  such  as  reading  achievement  may  need  particular  attention,  but  the  pattern  of 
positive  change  is  consistent,  especially  at  the  elementary  school  level.  While  the  changes 
observed  in  the  past  year  are  promising,  it  is  important  to  continue  observing  changes  over  the 
coming  years  and  to  use  the  more  detailed  information  available  in  this  report  to  focus  in  on 
specific  areas  which  may  be  in  need  of  additional  attention. 
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Introduction 


No  single  indicator  can  give  a  complete  picture  of  a  school  system,  particularly  one  like  Boston 
which  enrolls  nearly  60,000  students  ranging  in  age  from  3  to  the  early  twenties,  informs  and 
involves  over  100,000  parents,  employs  more  than  5,000  professionals,  and  maintains  a 
physical  plant  of  over  125  buildings.  In  an  effort  to  cope  with  the  complexity  of  the  school 
system,  administrators  and  observers  have  tended  to  rely  on  one  or  two  statistics  at  a  time  to 
describe  the  'health'  of  the  school  system.  These  statistics  have  usually  been  annual  dropout 
rates.  Metropolitan  Achievement  Test  scores,  and/or  promotion  rates.  While  everyone  realizes 
that  a  single  number  can  be  misleading,  people  have  reported,  commented  on,  and  often  acted 
(or  reacted)  based  upon  the  value,  high  or  low,  of  a  single  statistic.  It  is  not  that  any  of  the 
single  statistics  is  'wrong',  but  rather  that  a  single  statistic  is  only  one  indicator  of  the  complex 
functioning  of  die  schools. 

Over  the  past  few  years,  there  has  been  much  work  to  develop  a  better  way  to  describe  the 
status  of  individual  students,  individual  schools,  and  the  entire  school  system.  At  the  student 
level,  this  has  involved  work  to  develop  and  use  ongoing  assessment  procedures  and  to 
provide  more  detailed  information  about  performance  on  standardized  tests  such  as  the 
individual  student  report  provided  to  teachers  each  fall.  The  ongoing  assessment  procedures 
are  sometimes  called  'performance  assessment',  'writing  folders',  'portfolio  assessment',  etc. 
Also,  the  format  of  the  student  report  card  has  been  modified  for  the  early  grade  levels  to 
provide  parents  with  more  information  about  their  child's  performance.  At  the  school  level,  the 
Boston  Compact  Measurement  Committee  has  been  working  with  the  Superintendent  and  the 
Zone  Superintendents  to  identify  a  set  of  performance  indicators  and  corresponding  standards 
to  use  to  assess  schools.  The  work  of  the  Boston  Compact  Measurement  Committee  has 
occurred  in  conjunction  with  certain  provisions  of  the  contract  between  the  Boston  Teachers 
Union  (BTU)  and  the  School  Department  which  call  for  a  yearly  assessment  of  schools. 
Finally,  at  die  system  level,  during  the  past  year,  the  Superintendent  has  emphasized  the  yearly 
annual  education  plan  process  whereby  schools  have  been  called  upon  to  formulate  objectives, 
measures  of  success,  and  action  plans  in  order  bring  about  school  improvement. 

How  is  the  Status  of  the  Boston  Public  Schools  Vis-A-Vis  the  Performance 
Indicators  Reported? 

This  Performance  Indicators'  Svstemwide  Report  is  designed  to  provide  information  about  the 
status  of  die  system  as  a  whole  and  to  provide  information  about  the  various  'performance 
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indicators'  that  have  been  identified  for  use  in  the  assessment  process.  Thus,  this  report 
examines  the  status  of  the  school  system  from  two  perspectives.  The  report  begins  with  a 
section  in  which  the  performance  indicators  are  combined  according  to  three  broad  categories 
described  below  to  produce  an  overall,  or  aggregate,  view  of  the  progress  of  the  school  system 
during  the  past  year  by  school  level,  i.e.,  elementary,  middle  and  high.  The  final  three 
sections,  one  for  each  of  the  broad  categories,  examine  the  performance  indicators  in  greater 
detail.  In  most  cases,  there  is  a  two  page  summary  for  each  indicator.  The  summary  begins 
with  a  description  of  each  indicator  in  terms  of  its  definition,  relevance,  and  manner  in  which  it 
is  calculated.  Next,  data  for  the  past  three  school  years  are  discussed  and  graphically 
represented  by  school  level.  Finally,  to  give  a  indication  of  the  prevalence  of  change  regarding 
the  indicator,  there  is  an  analysis  of  the  number  of  schools,  by  level,  that  have  changed, 
positively  or  negatively,  or  stayed  the  same  between  SY 1990-91  and  SY 199 1-92. 

While  die  bulk  of  this  report  is  comprised  of  an  indicator- by- indicator  analysis,  the  reader  is 
advised  to  keep  in  mind  that  the  purpose  of  this  repon  and  indeed  the  purpose  of  identifying  a 
set  of  performance  indicators  is  to  provide  a  means  to  obtain  a  fuller  picture  of  the  status  of  the 
school  system.  Also  included  in  the  area  of  student  achievement  are  the  median  percentile  test 
scores  in  Reading  and  Mathematics  on  the  Metropohtan  Achievement  Test  and  a  comparison  of 
the  standardized  test  scores  with  those  of  other  urban  school  systems.  Thus,  in  considering 
this  wealth  of  data,  the  reader  is  urged  to  move  back  and  forth  between  a  focused  examination 
of  specific  details  to  a  more  global  look  at  the  'whole'  picture. 

What  Is  a  Performance  Indicator? 

In  September,  1992  each  school  received  an  'End-of-Year  Report'  that  provided  approximately 
200  different  pieces  of  information  about  their  school's  functioning  during  the  past  diree  school 
years.  Among  the  various  data  elements  included  in  that  report,  nineteen  performance 
indicators  have  been  designated  as  the  key  indicators.  These  indicators  were  chosen  for  a 
variety  of  reasons  including  appropriateness,  completeness,  and  availability.  This  Performance 
Indicators:  Svstemwide  Report  1991-92  provides  status  information  about  tiiese  nineteen  key 
indicators  (listed  in  Table  A).  Each  indicator  is  fully  described  in  the  'Analysis  of  Indicators' 
section  of  this  report.  (As  a  supplement  to  these  nineteen  indicators,  schools  received 
supporting  data  from  fifteen  additional  indicators.  These  supporting  indicators  are  listed  in 
Appendix  A,  Table  1.  The  data  for  these  supporting  indicators  are  not  presented  in  this  report, 
but  they  were  used  at  the  local  school  level  to  determine  specific  areas  on  which  to  focus  in  the 
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educational  planning  process.  Appendix  A  also  contains  a  methodology  section  which 
discusses  technical  issues  related  to  the  various  indicators  and  the  analyses  used  in  this  repon.) 

The  performance  indicators  are  simply  numbers.  As  numbers,  the  indicators  are  designed  to 
provide  a  snapshot  of  small  facets  of  this  intricate,  ever  changing  entity  known  as  a  school. 
Thus,  the  indicators  should  be  viewed  as  signs  or  pointers  about  the  successes,  failures,  and 
current  status  of  individual  schools  and  the  school  system  as  a  whole.  As  numbers,  the 
indicators  should  not  be  mistaken  for  the  school  itself.  Finally,  as  numbers,  the  indicators 
should  not  be  mistaken  for  the  students,  parents,  teachers,  school  administrators  and  other 
members  of  the  school  community  that  have  been  involved  in  the  complex  activity  known  as 
education.  Yet,  as  signs  and  pointers,  the  performance  indicators  are  meaningful. 
Individually,  performance  indicators  are  starting  points,  not  ending  points  in  the  process  of 
understanding  an  individual  school  or  the  system  as  a  whole.  Taken  together  and  combined 
with  other  information  one  has  about  a  school,  the  performance  indicators  are  the  vital  signs 
about  a  school's  functioning  which  can  be  checked  on  a  yearly  basis  to  be  sure  that  all  is  well 
with  the  school.  Taken  together,  if  the  indicators  highlight  potential  problem  areas,  more 
information  will  need  to  be  obtained.  Depending  on  the  information  obtained,  the  school  may 
be  in  need  of  additional  support  or  intervention.  Procedures  for  this  follow-up  process  have 
been  detailed  in  a  Superintendent's  Circular  (#24,  1992-93). 

Where  Do  the  Performance  Indicators  Data  Come  From? 

Over  the  past  sixteen  years  or  so  the  Boston  Public  Schools,  through  the  Office  of  Information 
Systems,  has  developed  a  comprehensive  computerized  central  record  keeping  system.  The 
informadon  contained  in  this  computer  system  comes  from  many  different  sources,  and  there 
are  guidelines  set  up  to  ensure  the  integrity,  accuracy,  and  confidentiality  of  the  information 
The  data  for  the  school  performance  indicators  come  from  the  schools,  the  Department  of 
Implementation,  the  Department  of  Testing,  the  Special  Education  Compliance  Unit,  the 
Bilingual  Education  Lau  Unit  and  the  Department  of  Safety  Services. 
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Table  A 
Key  School  Performance  Indicators 

School   Holding  Power/Climate 

1 .  Daily  Student  Attendance 

2.  Suspension  Occurrences 

3.  Pupils  Suspended 

4.  St^  Attendance 

5 .  School  Choice 

6.  Dropouts 

Student  Achievement 

1.  Promotions 

2 .  Metropolitan  Achievement  Test  of  Reading:  Below  Average  Performance 

3 .  Metropolitan  Achievement  Test  of  Mathematics:  Below  Average  Performance 

4.  Metropolitan  Achievement  Test  of  Reading:  Average  Performance 

5 .  Metropolitan  Achievement  Test  of  Mathematics:  Average  Performance 

6.  Metropolitan  Achievement  Test  of  Reading:  Above  Average  Performance 

7 .  Metropolitan  Achievement  Test  of  Mathematics:  Above  Average  Performance 

School  Involvement  Practices 

1 .  Special  Education  Prototype  Increase 

2 .  Special  Education  Prototype  Decrease 

3 .  Special  Education  New  Referrals 

4.  Bilingual  Education  Step  Increase 

5 .  M AT6  Reading  -  Students  Taking  the  Test 

6 .  MAT6  Mathematics  -  Students  Taking  the  Test 
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How  Can  the  Performance  Indicators  Be  Combined? 

There  are  many  potential  ways  to  group  the  performance  indicators.  For  purposes 
of  discussion  in  this  report,  the  indicators  have  been  grouped  into  the  three  broad 
categories  Usted  below.  These  three  categories  are  somewhat  separate,  yet  they  are 
interrelated.  There  is  no  simple  direct  cause  and  effect  relationship  among  the 
categories. 

School   Holding  Power/Climate 

This  category  refers  to  the  holding  and  drawing  power  of  a  school. 
Indicators  included  in  this  category  are:  student  attendance,  staff 
attendance,  student  suspensions,  parent  choice  of  the  school  during 
the  student  assignment  process,  and  dropouts. 

Student  Achievement 

This  category  refers  to  the  ways  that  students  demonstrate  that  they 
have  mastered  the  curriculum.  Included  in  this  category  are  the 
grade  promotion  indicator  and  the  Metropolitan  Achievement  Test 
indicators. 

School   Involvement  Practices 

This  category  refers  to  the  implementation  of  various  policies  and 
procedures  that  affect  students'  involvement  in  the  mainstream 
activities  of  the  school.  The  indicators  that  are  included  in  this 
category  are  those  that  provide  information  about  the  degree  to 
which  Special  Education  and  Bilingual  Education  students  are 
participating  in  the  regular  education  setting,  and  the  emphasis  that 
the  school  places  on  ensuring  that  all  eligible  students  take  the  yearly 
Metropolitan  Achievement  tests. 
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Systemwide  Aggregate  Summary 


Overview 

This  chapter  summarizes  the  changes  which  have  occurred  at  each  school  level, 
elementary,  middle,  and  high,  during  the  past  school  year.  Changes  in  the  areas  of 
School  Holding  Power/Climate,  Student  Achievement,  and  School  Involvement 
F*ractices  are  examined. 

Procedures 

Within  each  broad  category,  i.e.,  School  Holding  Power/Climate,  Student 
Achievement,  and  School  Involvement  Practices,  the  individual  indicators  can  be 
combined  both  by  looking  for  changes  over  time  and  by  looking  for  patterns  among 
the  set  of  indicators.  The  graph  in  Figure  #1  shows  changes  in  the  School  Holding 
Power/Climate  indicators  for  Elementary  Schools  between  SY 1990-91  and 
SY 199 1 -92.  Bars  that  extend  to  the  right  of  the  0%  vertical  line  in  the  graph 
represent  improvements  in  an  indicator  during  this  time  span.  Bars  that  extend  to 
the  left  of  the  0%  Une  indicate  a  decline  in  an  indicator  during  this  time  span.  The 
longer  the  bar,  the  greater  the  amount  of  change. 

The  remainder  of  this  chapter  examines  the  pattem  of  changes  that  have  occurred 
during  the  past  year  for  each  school  level.  The  graphs  are  based  upon  comparison 
of  summary  statistics  for  each  performance  indicator,  either  means  or  total  counts, 
between  SY1990-91  and  SY1991-92.  To  quantify  the  amount  of  change  between 
SY1990-91  and  SY1991-92,  the  difference  between  the  two  years  was  calculated 
and  then  divided  by  the  value  for  the  'base'  year,  i.e.  SY1990-91.  This  result  was 
then  converted  into  a  percentage.  A  positive  percentage  indicates  an  improvement 
in  the  status  of  the  performance  indicator.  A  negative  percentage  indicates  a  decline 
in  the  status  of  the  performance  indicator.  These  procedures  are  described  in 
greater  detail  in  the  Technical  Issues"  section  of  Appendix  A. 
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Systemwide   Aggregate   Summary 

Elementary  School  Level  Performance  Indicators: 
Aggregate  Changes  During  SY1991-92 

At  the  Elementary  School  Level,  the  performance  indicators  suggest  that,  overall, 
schools  became  more  desirable  during  SY 199 1-92  and  that  there  were  changes  in 
School  Involvement  Practices  which  resulted  in  greater  involvement  in  the  school 
community  among  students.  Small  improvements  were  also  observed  in  Student 
Achievement.  This  information  is  represented  graphically  in  Figure  #1  and 
numerically  in  Table  #1.  Thus  overall,  the  Elementary  Schools  have  demonstrated 
consistent  evidence  of  school  improvement  during  the  past  school  year. 

Table  #1 

Elementary  School  Level 

Apprepafe   Change  Retween   SY199n.91    and  SY1 991-92 


School    Holding    Power/Climate 

1 .  Daily  Student  Attendance 

2.  Suspension  Occurrences 

3.  Pupils  Suspended 

4.  Staff  Attendance 

5.  School  Choice 

6.  Dropouts 

Student    Achievement 

1.  Promotions 

2.  MAT6  Reading  Below  Average  Performance 

3.  MAT6  Mathematics  Below  Average  PerfOTmance 

4.  MAT6  Reading  Average  Performance 

5.  MAT6  Mathematics  Average  Performance 

6.  MAT6  Reading  Above  Average  Performance 

7.  MAT6  Mathematics  Above  Average  Performance 

School    Involvement    Practices 

1 .  Special  Education  Prototype  Increase 

2.  Special  Education  Prototype  Decrease 

3 .  Special  Education  New  Referrals 

4.  Bilingual  Education  Step  Increase 

5.  MAT6  Reading  -  Students  Taking  the  Test 

6.  MAT6  Mathematics  -  Students  Taking  the  Test 

*       As  noted  in  the  procedures  section  and  Appendix  A,  for  comparison  purposes,  these  indicators  have  been 
converted  so  that  improvements  are  shown  as  positive  percentages.  See  Appendix  A  for  an  example. 


Chan 

ige 

Rate 

l£A£ 

-1.1% 

decline 

16.7%  • 

improvement 

10.9%  * 

improvement 

0.6% 

improvement 

3.8% 

improvement 

NA 

0.2% 

improvement 

0.3%  * 

improvement 

2.9%  * 

improvement 

-1.9% 

decline 

-2.2% 

decline 

0.2% 

improvement 

1.0% 

improvement 

7.7%  * 

improvement 

21.6% 

improvement 

6.6%  • 

improvement 

20.3% 

improvement 

-0.5% 

decline 

-0.6% 

decline 

PAGE  12 


Systemwide  Aggregate  Summary 
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Figure  1 

Boston  Public  Schools 

Elementary  School  Performance  Indicators:  Changes 

Over  the  Past  Year 


{ 


{ 


Student  At1»ndano» 
Statt  Anandanca 
School  Choica 
Pupils  Suspended 
Suspension  Occurrences 


Mathematics  Average 

Reading  Average 

Reading  Above  Average' 

Promocions 

Reading  Below  Average 

N4athematics  Abcve  Average 

Malherriatics  Below  Average 


Students  Taking  the  Test    Mathematics 
Students  Takir>g  the  Test    Reading 
Special  Education  New  Referrals 
Special  Education  Prototype  increases 
Bilingual  Education  Step  Increases 
Special  Education  Prototype  Decreases 


T 


T 


-30% 


0% 


-20%  -10% 

Decline 

(Note:  The  indicators  are  listed  in  order  o<  magnHude  ) 
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School  Holding  Power/Climate 

Of  the  five  indicators  considered,  improvement  could  be  seen  in  four  of  them.  The 

largest  improvements  were  observed  in  Pupils  Suspended  and  Suspension 

Occurrences 

Student  Achievement 

Some  improvements  were  observed  in  five  of  the  seven  areas.  The  percentage  of 
students  in  the  average  range  in  both  Reading  and  Mathematics  declined  slightly. 
However,  it  is  important  to  note  that  at  all  grade  levels  in  both  Reading  and 
Mathematics,  the  median  percentiles  for  all  grades  are  above  the  average  range. 

School  Involvement  Practices 

Improvements  were  observed  in  moving  both  Special  Education  and  Bilingual 

Education  students  more  into  the  mainstream. 
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Systemwide  Aggregate  Summary 

Middle  School  Level  Performance  Indicators: 
Aggregate  Changes  During  SY1991-92 

Among  BPS  Middle  Schools,  the  performance  indicators  for  School  Holding 
Power/Climate  suggest  that  the  schools  have  become  more  desirable.  This 
information  is  represented  graphically  in  Figure  #2  and  numerically  in  Table  #2.  In 
the  areas  of  School  Involvement  Practices  and  Student  Achievement,  there  is 
evidence  of  improvement  in  both  areas.  However,  since  the  status  of  some 
performance  indicators  declined,  the  data  also  suggest  that  improvement  has  been 
somewhat  uneven  in  these  two  areas. 

Table  #2 

Middle  School  Level 

Aggregate  Change  Between  SY1990.91   and  SY1991-92 


School    Holding    Power/Climate 

1 .  Daily  Student  Attendance 

2.  Suspension  Occurrences 

3.  Pupils  Suspended 

4.  Staff  Attendance 

5.  School  Choice 

6.  E>ropouts 

Student    Achievement 

1.  Promotions 

2.  MAT6  Reading  Below  Average  Performance 

3 .  MAT6  Mathematics  Below  Average  Performance 

4.  MAT6  Reading  Average  Perfwmance 

5 .  MAT6  Mathematics  Average  Performance 

6.  MAT6  Reading  Above  Average  Performance 

7.  MAT6  Mathematics  Above  Average  PerfcHinance 

School    Involvement    Practices 

1 .  Special  Education  Prototype  Increase 

2.  Special  Education  Prototype  Decrease 

3 .  Special  Education  New  Referrals 

4.  Bilingual  Education  Step  Increase 

5.  MAT6  Reading  -  Students  Taking  the  Test 

6.  MAT6  Mathematics  -  Students  Taking  the  Test 

*       As  noted  in  the  procedures  section  and  Appendix  A.  for  comparison  purposes,  these  indicators  have  been 
converted  so  that  improvements  are  shown  as  positive  f>ercentages.  See  Appendix  A  for  an  example. 
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Systemwide  Aggregate   Summary 
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Figure  2 

Boston  Public  Schools 

Middle  School  Performance  Indicators: 

Changes  Over  the  Past  Year 
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School  Holding  Power/Climate 

Improvements  were  observed  for  all  six  indicators  with  the  largest  improvements  in 

the  areas  of  Dropouts  and  Suspension  Occurrences. 

Student  Achievement 

Some  improvements  were  observed  in  Mathematics  achievement  but  there  were  also 
some  declines  in  Reading  Achievement  and  Promotions.  However,  it  is  important 
to  note  that  for  all  grades  the  median  percentiles  for  Mathematics  are  above  the 
national  average  and  for  Reading  only  shghdy  below  the  national  average. 

School  Involvement  Practices 

Improvements  were  observed  in  four  of  the  six  indicators  considered,  with  the 
largest  improvement  occurring  in  die  Bilingual  Education  Step  Increases,  which 
means  that  these  students  are  spending  more  time  in  the  regular  education  settings. 
New  referrals  to  Special  Education  also  decreased.  Changes  in  Special  Education 
Prototype  placements  were  mixed. 
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Systemwide  Aggregate  Summary 

High  School  Level  Performance  Indicators: 
Aggregate  Changes  During  SY1991-92 

At  the  High  School  level,  the  performance  indicators  suggest  that  improvements 
have  occurred  in  each  of  the  three  categories,  with  some  improvements  being  quite 
substantial.  However,  within  both  the  School  Holding  Power/CUmate  and  Student 
Achievement  categories,  there  are  more  indicators  that  show  decline  than  show 
improvement.  The  School  Involvement  Practices  category  is  also  mixed  in  terms 
of  improvement  and  decline.  This  information  is  represented  graphically  in  Figure 
#3  and  numerically  in  Table  #3.  Overall,  improvement  at  the  High  School  level 
appears  to  be  occurring  somewhat  unevenly. 

Table  #3 

High  School  Level 

Aggregate  Change  Between  SY1990.91    and  SY1991-92 


School    Holding    Power/Climate 

1 .  Daily  Student  Attendance 

2.  Suspension  Occurrences 

3.  Pupils  Suspended 

4.  Staff  Attendance 

5.  School  Choice 

6.  Dropouts 

Student    Achievement 

1.  Promotions 

2.  MAT6  Reading  Below  Average  Performance 

3 .  MAT6  Mathematics  Below  Average  Performance 

4.  MAT6  Reading  Average  Perfonnance 

5.  MAT6  Mathematics  Average  Perfonnance 

6.  MAT6  Reading  Above  Average  Perfonnance 

7.  MAT6  Mathematics  Above  Average  PerfOTmance 

School    Involvement    Practices 

1 .  Special  Education  Prototype  Increase 

2.  Special  Education  Prototype  Decrease 

3 .  Special  Education  New  Referrals 

4.  Bilingual  Education  Step  Increase 

5.  MAT6  Reading  -  Students  Taking  the  Test 

6.  MAT6  Mathematics  -  Students  Taking  the  Test 

*       As  noted  in  the  procedures  section  and  Appendix  A,  for  comparison  purposes,  these  indicators  have  been 
converted  so  that  improvements  are  shown  as  positive  percentages.  See  Appendix  A  for  an  example. 
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Systemwide  Aggregate  Summary 


Figure  3 

Boston  Public  Schools 

High  School  Performance  Indicators: 

Changes  Over  the  Past  Year 
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School  Holding  Power/Climate 

Improvements  were  observed  in  two  of  the  six  indicators  considered  These 
improvements  were  in  the  increased  number  of  School  Choices  made  and  in  the 
reduction  in  the  annual  Dropwut  rate. 

Student  Achievement 

Improvements  were  observed  in  two  of  the  seven  indicators  considered.  Some 
improvement  was  observed  in  Mathematics  achievement  in  terms  of  the  percentages 
of  students  scoring  below  average.  There  were,  however,  declines  in  the 
percentages  of  students  scoring  above  average  in  Reading  and  Mathematics. 

School  Involvement  Practices 

Improvements  were  observed  in  four  of  the  six  indicators  considered.  In  particular 
large  imporvements  were  noted  in  greater  percentages  of  Special  Education  and 
Bilingusd  Education  students  spending  more  time  in  regular  education  settings. 
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Systemwide  Aggregate  Summary 

Has  the  System  Improved  Between  SY 1990-91  and  SY1991-92? 

At  all  three  school  levels,  there  is  considerable  and  generally  consistent  evidence 
that  schools  have  improved  both  in  terms  of  School  Holding  Power/Climate  and 
School  Involvement  Practices  which  promote  student  involvement  in  the 
mainstream.  There  is  also  some  evidence  of  improvement  in  Student  Achievement, 
but  changes  in  this  category  were  generally  smaller  than  changes  in  the  other  two 
categories.  The  next  section  of  this  report  examines  the  changes  for  each  indicator 
in  greater  detail. 
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Daily  Student  Attendance 


Description:  Student  attendance  is  an  indicator  of  student  exposure  to  school  instruc- 
tion. High  student  attendance  is  an  obvious  basic  requirement  underlying  school  effec- 
tiveness. The  student  attendance  is  a  percentage  calculated  as  the  average  daily 
attendance  divided  by  the  average  daily  membership  based  on  data  provided  by  each 
school  to  the  Records  Management  Unit.  The  percentage  is  computed  only  from  the  par- 
ticular grades  in  each  school,  excluding  kindergarten. 


Historical  Perspective:  During  the  past  three  years  the  systemwide  average  daily  atten- 
dance (grades  1  to  12)  has  remained  relatively  stable  at  around  89%.   At  the  elementary 
and  middle  school  levels  the  rate  has  remained  fairly  even  around  93%  and  89%  respec- 
tively.      At   the 
high  school  level 
average        daily 
attendance      de- 
clined one  point 


this  past  year. 
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Daily  Student  Attendance 


Change  Between  SY1990-91  and  SY 1991-92: 


Percent  of  Schools 
Increased,  Maintained  and  Decreased 

Daily  Student  Attendance 
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Between  one  quarter  and  one  third  of  the 
schools  improved  their  Aver- 
age Daily  Student  Attendance. 
The  most  improvement  oc- 
curred among  middle  schools. 
Approximately  one  quarter  of 
the  schools  maintained  their 
previous  year's  attendance  lev- 
el. It  should  be  noted  that 
during  SY  199 1-92  there  was  a 
four  and  a  half  week  bus 
strike  which  affected  the 
attendance  rate. 


SY1 990-91  TOSY1991-92 
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Suspension  Occurrences 


Description:  The  total  number  of  suspension  occurrences  indicates  a  problem  which  has 
an  impact  on  the  total  school  climate  and  atmosphere.  This  number  reflects  the  total 
number  of  times  that  suspensions  arc  recorded  during  the  school  year;  students  are 
counted  each  time  they  arc  suspended.  Data  reflect  suspension  activity  at  the  school  dur- 
ing the  year  even  if  a  student  transfers  to  another  school  before  the  end  of  the  year  (so  a 
student  may  be  counted  at  more  than  one  school). 


Historical  Perspective:  Systemwide,  during  the  past  three  years,  the  total  number  of 
suspension  occurrences  declined  5%  from  this  past  year  following  an  increase  from 
SY 1989-90.  This  pattern  was  reflected  at  the  elementary  school  level.  At  the  middle 
school  level  the  number  has  decreased  3%  from  1217  to  1184  over  the  past  three  years. 
At  the  high 
school  level  the 
number  of  sus- 
pension occur- 
rences increased 
slightly  (1%) 
from  the  past 
year. 
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Suspension  Occurrences 


Percent  of  Schools 
Increased,  Maintained  and  Decreased 

Suspension  Occun-ences 


Elementary 


36% 


25% 


39% 


Change  Between  SY1990-91  and  SY1991-92:     SlighUy  over  half  of  the  niiddle  and  high 
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tween SY1990-91  and 
SY1991-92.  Almost  40%  of 
the  elementary  schools  also 
had  improvements 

(decreases).  One  quarter  of 
the  elementary  schools  main- 
tained the  same  number  of 
suspension  occurrences,  in 
large  part  because  a  number  of 
elementary  schools  suspended 
no  students  at  all  in  either 
year.    It  should  be  noted  that 

at  the  elementary  level  the  number  are  small,  so  the  percentage  of  change  should  be  interpreted 
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Pupil  Suspensions 


Description:  The  total  number  of  suspension  occurrences  indicates  a  problem  which  has 
an  impact  on  the  total  school  climate  and  atmosphere.  If  a  school  has  many  more  sus- 
pension occurrences  than  suspended  pupils,  it  means  that  a  few  students  are  being  sus- 
pended repeatedly.  Data  reflect  suspension  activity  at  the  school  during  the  year  even  if 
a  student  transfers  to  another  school  before  the  end  of  the  year  (so  a  student  may  be 
counted  at  more  than  one  school). 


Historical  Perspective:  Systemwide,  during  the  past  three  years,  the  total  number  of  pu- 
pils suspended  declined  3%  from  this  past  year  following  an  increase  from  SYl 989-90. 
This  pattern  was  reflected  at  the  elementary  and  middle  school  levels.  At  the  high  school 
level,  the  number 
of     pupils     sus-     f 


pended  increased 
slighdy  (3%) 
from  the  past 
year. 
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Pupil  Suspensions 


Change  Between  SY1990-91  and  SY1991-92:   Over  half  of  the  middle  and  high  schools  had 

improvements   (decreases)   in 


Percent  of  Schools 
Increased,  Maintained  and  Decreased 

Pupils  Suspended 


Elementary 


42% 


Midde 


High 


53% 


■■    Increased 
I       i    Maintained 
^S    Oecreetsed 


47% 

0% 

':':':':':-:'fe:^:w:':$:-:'.'^^^^^^  307o 


SY1990-91  TO  SY 1991 -92 


the  number  of  pupils  sus- 
pended between  SY  1990-91 
and  SYl 991-92.  At  all  three 
levels,  schools  with  decreases 
outnumbered  schools  with  in- 
creases. One  quaner  of  the 
elementary  schools  main- 
tained the  same  number  of  pu- 
pils suspended,  in  large  part 
because  a  number  of  elemen- 
tary schools  suspended  no  stu- 
dents at  all  in  either  year.  It 
should  be  noted  that  for  many 
elementary  schools,  the  num- 


ber of  pupils  suspended  is  very  small  and,  thus,  should  be  interpreted  with  caution. 
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Staff  Attendance 


Description:  While  absences  due  to  illness  are  inevitable,  high  staff  attendance  is  a  pre- 
requisite for  high  standards  in  the  delivery  of  school  services.  "Staff  includes  adminis- 
trators, teachers,  and  professional  support  staff,  but  does  not  include  other  support  staff. 
Days  absent  include  only  sick  days.  Attendance  at  approved  educational  conferences, 
personal  days,  and  approved  leaves  arc  excluded.  Staff  attendance  is  calculated  as  the  to- 
tal number  of  staff  days  present  divided  by  the  total  number  of  staff  days  possible. 


Historical  Perspective:  Systemwide,  the  percent  average  daily  staff  attendance  during 
the  past  three  years  has  remained  high  at  96%.  At  the  elementary  and  middle  school  lev- 
els the  average  daily  staff  attendance  has  risen  slightiy  from  96%  in  SY 1989-90  to  97% 
for  SY  1991 -92.  At  the  high  school  level  the  average  daily  staff  attendance  has  remained 
constant  at  96%. 
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Staff  Attendance 


Change  Between  SY1990-91  and  SY1991-92:     Approximately  half  of  the  elementary  and 
^^^^^^^^^^^^^^^_^^^^^^^^^^^^^^^^^^^      middle    schools    showed    in- 


Percentage  of  Schools 
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Staff  Attendance 
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creases  in  staff  attendance  be- 
tween SY 1990-91  and 
SY1991-92.  The  majority  of 
the  high  schools  maintained 
the  same  level  of  staff  atten- 
dance in  both  years. 
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School  Choice 


Description:  The  number  of  students  requesting  a  school  as  a  fu"st  choice  is  the  number 
of  regular  education  students  in  grades  1,  6,  and  9  who  requested  the  school  as  their  top 
choice  in  the  first  round  of  the  student  assignment  process.  It  is  an  indicator  of  how  de- 
sirable the  school  is  seen  as  being.  In  the  case  of  fu-st  grade,  parents  whose  child  had  a 
guaranteed  seat  and  therefore  did  not  make  a  choice  are  not  included  in  the  counts. 
Regular  education  students  only  were  included  in  these  analyses,  since  the  choices  of  oth- 
er students  (such  as  Bilingual  or  Special  Needs)  are  more  constrained  by  the  availability 
of  specific  programs. 


Historical  Perspective:  Systemwide,  the  number  of  first  choices  has  increased  11%. 
This  increase  over  the  past  three  years  is  reflected  at  all  three  levels  with  a  20%  increase 
at  the  elementary  school  level,  a  9%  at  the  middle  school  level  and  1%  increase  at  the 
high  school  level. 
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School  Choice 


Change  Between  SY1990-91  and  SY1991-92:  Three  quarters  of  the  high  schools  and  approxi- 
mately half  of  the  elementary 


Percentage  of  Schools 
Increased,  Maintained  and  Decreased 

School  Choice 
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and  middle  schools  showed 
increases  in  the  number  of 
times  they  were  given  as  "first 
choice"  during  Round  I  of  the 
student  assignment  process. 
Regular  education  students 
only  were  included  in  these 
analyses,  since  the  choices  of 
other  students  are  more  con- 
strained by  the  availability  of 
specific  programs. 
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Dropouts 


Description:  The  dropout  rate  is  generally  regarded  as  one  index  of  a  school's  holding 
power.  According  to  new  state  guidelines,  students  in  grades  6-12  are  counted  as  drop- 
outs if  they  leave  school  during  the  year  from  July  1  to  June  30  for  any  reason  other  than 
transfer,  graduation,  death,  or  expulsion  with  an  option  to  return,  regardless  of  whether 
or  not  they  are  16  years  old.  For  these  analyses,  dropout  data  from  the  years  before 
1991-1992  have  been  re-analyzed  to  conform  to  new  state  guidelines  and  provide  a  con- 
sistent basis  for  comparison  across  time.  This  indicator  applies  primarily  to  high  schools. 


Historical  Perspective:    During  the  past  three  years,  the  annual  dropout  rate  for  high 
school,  recalculated  to  conform  to  the  new  state  guidelines,  has  declined  from  10%  to 
9%.         At     the 
middle  school 
level,   the   drop- 
out rate  has  re- 
mained  constant 
at  2%. 
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Dropouts 


Change  Between  SY1990-91  and  SY1991-92:  Over  half  of  the  middle  schools  and  almost  half 

of  the  high  schools  had  de- 
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creases  in  their  dropout  rate 
between  SY 1990-91  and 
SY 199 1-92.  (Note:  For  pur- 
poses of  this  analysis,  the  To- 
bin  and  Hemandez  elementary 
schools,  6th-8di  graders  only, 
were  included  among  the 
middle  schools). 
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Student  Achievement 


PAGE  3: 


Promotions 


Descriptions:  Promotion  represents  an  achievemont  both  for  students  and  for  their 
school.  The  promotion  rate  used  in  these  analyses  is  intended  to  reflect  achievement  dur- 
ing the  school  year,  therefore,  it  is  calculated  as  the  percentage  of  students  promoted  to 
the  next  grade  as  of  June.  It  does  not  include  those  students  who  are  promoted  during 
summer. 


Historical  Perspective:  During  the  past  three  years,  the  systemwide  promotion  rate  has 
remained  stable  at  93%.  The  already  high  promotion  rates  at  the  elementary  and  middle 
school  levels  showed  increases  between  SY 1989-90  and  SY 1991 -92  of  2%  and  1% 
respectively. 
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Promotions 


Change  Between  SY1990-91  and  SY1991-92:  Increases  in  the  promotion  rate  were  seen  at  all 
levels,  40%,  47%,  and  60%  at  the  elementary,  middle,  and  high  school  levels.  It  should  be  noted 

that  26%  of  the  elementary 

schools  "maintained"  the 
promotion  rate  which  often 
means  that  the  school  sus- 
tained a  promotion  rate  that 
was  already  quite  high. 
Among  middle  schools,  the 
number  of  schools  increas- 
ing matched  the  number  of 
schools  decreasing  in 
promotion  rate,  while  at  the 
high  school  and  elementary 
levels  the  number  of  schools 
with  increases  was  greater 
than  the  number  with 
decreases. 
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Metropolitan  Achievement  Test  Reading 
Elementary  School  Level:  Score  Ranges 


Description:  Students  who  score  below  average  (under  the  40th  percentile  compared 
with  national  norms)  may  be  at  risk  of  failure  in  reading.  Average  scores  (40th  to  60th 
percentile)  are  predictive  of  satisfactory  performance  in  school  subjects  which  rely  on 
reading  skills.  Students  who  score  above  average  (over  the  60th  percentile)  are  likely  to 
be  able  to  achieve  at  a  high  level.  In  all  analyses  of  MAT6  scores,  the  percentages  are 
based  on  the  total  number  of  eligible  students,  not  solely  those  who  took  the  test.  The 
eligible  population  includes  the  following  students:  Regular  education.  Special  Needs  in 
.1  and  .2  prototypes,  and  Bilingual  Education  in  Lau  Steps  4  and  5.  In  addition  to  the 
eligible  population,  schools  are  encouraged  to  include  all  students  in  Bilingual  Education 
Steps  2  and  3  and  Special  Education  Prototypes  .3  and  .4  who  are  able  to  take  the  test. 


Historical  Perspective: 

ble  elementary  students 
politan  Achieve- 
ment Test  in 
reading  has  re- 
mained nearly 
constant.  The 
percentage  scor- 
ing below  aver- 
age has  been  7  to 
8  percentage 
points  less  than 
in  the  national 
norming  sample 
(40%). 


Systemwide,  during  the  past  three  years,  the  percentage  of  eligi- 
scoring  at  each  of  the  three  levels  of  proficiency  on  the  Metro- 


MAT6  Reading  Elementary  School  Level 
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Metropolitan  Achievement  Test  Reading 
Elementary  School  Level:  Score  Ranges 


f 


Median  Percentile  Between  SY1989-90  and  SY1991-92:  During  the  past  three  years,  the  me- 
dian percentile  at  each  ele- 
mentary grade  has  remained 
relatively  stable,  at  or  above 
national  median  on  the  MAT6 
reading  test.  First  grade  stu- 
dents have  improved  10  per- 
centile points  since 

Nabonal  SY1989-90. 

Median 


Metropolitan  Achievement  Test:  Reading 
Elementary  Level  Median  Percentiles 
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Metropolitan  Achievement  Test  Mathematics 
Elementary  School  Level:  Score  Ranges 


Description:  Students  who  score  below  average  (under  the  40th  percentile  compared 
with  national  norms)  may  be  at  risk  of  failure  in  mathematics.  Average  scores  (40th  to 
60th  percentile)  are  predictive  of  satisfactory  performance  in  mathematics.  Students  who 
score  above  average  (over  the  60th  percentile)  are  likely  to  be  able  to  achieve  at  a  high 
level.  In  all  analyses  of  MAT6  scores,  the  percentages  are  based  on  the  total  number  of 
eligible  students,  not  solely  those  who  took  the  test.  The  eligible  population  includes  the 
following  students:  Regular  education,  Special  Needs  in  .1  and  .2  prototypes,  and  Bilin- 
gual Education  in  Lau  Steps  4  and  5.  In  addition  to  the  eligible  population,  schools  are 
encouraged  to  include  all  students  in  Bilingual  Education  Steps  2  and  3  and  Special 
Education  Prototypes  .3  and  .4  who  are  able  to  take  the  test.. 


Historical  Perspective:  Systemwide,  during  the  past  three  years,  the  percentage  of  eligi- 
ble students  scoring  above  average  on  the  Metropolitan  Achievement  Test  in  Madie- 
matics  has  steadily  increased  from  48%  in  SYl 989-90  to  51%  in  SY 1991 -92.  This  most 
recent      percent- 


age is  11  points 
higher  than  the 
national  norming 
sample  in  the 
above  average 
range  and  16 
points  lower  than 
the  national  sam- 
ple for  the  below 
average  range. 
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Metropolitan  Achievement  Test  Mathematics 
Elementary  School  Level:  Score  Ranges 


Median  Percentile  Between  SY1989-90  and  SY 1991-92:  Overall,  during  the  past  three  yeais, 

the  median  percentile  at  each 
elementary    grade    has    been 


Metropolitan  Achievement  Test:  Math 
Elementary  Level  Median  Percentiles 
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well  above  the  national  aver- 
age. Each  grade  level  has  ex- 
ceeded the  national  median  by 
9  to  21  percentile  points  on 
the  mathematics  test. 
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Metropolitan  Achievement  Test  Reading 
Middle  School  Level:  Score  Ranges 


Description:  Students  who  score  below  average  (under  the  40th  percentile  compared 
with  national  norms)  may  be  at  risk  of  failure  in  reading.  Average  scores  (40th  to  60th 
percentile)  are  predictive  of  satisfactory  performance  in  reading.  Students  who  score 
above  average  (over  the  60th  percentile)  are  likely  to  be  able  to  achieve  at  a  high  level. 
In  all  analyses  of  MAT6  scores,  the  percentages  are  based  on  the  total  number  of  eligible 
students,  not  solely  those  who  took  the  test.  The  eligible  population  includes  the  follow- 
ing students:  Regular  education.  Special  Needs  in  .1  and  .2  prototypes,  and  Bilingual 
Education  in  Lau  Steps  4  and  5.  In  addition  to  the  eligible  population,  schools  are  en- 
couraged to  include  all  students  in  Bilingual  Education  Steps  2  and  3  and  Special  Educa- 
tion Prototypes  .3  and  .4  who  are  able  to  take  the  test.. 


Historical  Perspective:  Systemwide,  during  the  past  diree  years,  the  percentage  of  eligi- 
ble middle  school  students  scoring  scoring  at  each  of  the  three  levels  of  proficiency  on 
the  Metropolitan  Achievement  Test  in  reading  has  remained  essentially  constant.  The 
percentage        of 


students  scoring 
in  the  below  av- 
erage and  aver- 
age score  ranges 
is  close  to  the 
national  norming 
sample. 
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MAT6  Reading  Middle  School  Level 

Percentage  of  Eligible  Students 
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Metropolitan  Achievement  Test  Reading 
Middle  School  Level:  Score  Ranges 


Median  Percentile  Between  SY1989-90  and  SY 1991-92: 


Metropolitan  Achievement  Test:  Reading 
Middle  School  Level  Median  Percentiles 
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At  the  middle  school  level,  the 
reading  median  percentile  at 
each  grade  level  has  re- 
mained fairly  close  to  the  na- 
tional average  during  this 
period.  At  each  grade  the 
median  percentile  was  only 
one  to  two  percentile  points 
below  the  national  average 
for  this  past  year. 
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Metropolitan  Achievement  Test  Mathematics 
Middle  School  Level:  Score  Ranges 


Description:  Students  who  score  below  average  (under  the  40th  percentile  compared 
with  national  norms)  may  be  at  risk  of  failure  in  mathematics.  Average  scores  (40th  to 
60th  percentile)  are  predictive  of  satisfactory  performance  in  mathematics.  Students  who 
score  above  average  (over  the  60th  percentile)  are  likely  to  be  able  to  achieve  at  a  high 
level.  In  all  analyses  of  MAT6  scores,  the  percentages  are  based  on  the  total  number  of 
eligible  students,  not  solely  those  who  took  the  test.  The  eligible  population  includes  the 
following  students:  Regular  education,  Special  Needs  in  .1  and  .2  prototypes,  and  Bilin- 
gual Education  in  Lau  Steps  4  and  5.  In  addition  to  the  eligible  population,  schools  are 
encouraged  to  include  all  students  in  Bilingual  Education  Steps  2  and  3  and  Special 
Education  Prototypes  .3  and  .4  who  are  able  to  take  the  test.. 


Historical  Perspective:  Systemwide,  during  the  past  three  years,  the  percentage  of  eligi- 
ble middle  school  students  scoring  at  each  of  the  three  proficiency  levels  in  mathematics 
has  remained  rela- 
tively 


stable. 
There  was  an  in- 
crease in  the  per- 
centage of 
students  scoring  in 
the  above  average 
range  in 
SY1991-92. 


MAT6  Mathematics  Middle  School  Level 
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Metropolitan  Achievement  Test  Mathematics 
Middle  School  Level:  Score  Ranges 


Median  Percentile  Between  SY1989-90  and  SY1991-92:  During  the  past  three  years,  the  me- 
dian percentile  at  each  middle 


Metropolitan  Achievement  Test:  Math 
Middle  School  Level  Median  Percentiles 
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school  grade  has  remained 
fairly  stable,  at  or  above  the 
national  average  on  the 
mathematics  test.  The  me- 
dian for  7th  grade  students 
increased  by  2  percentile 
points  during  the  past  year. 
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Metropolitan  Achievement  Test  Reading 
High  School  Level:  Score  Ranges 


Description:  Students  who  score  below  average  (under  the  40th  percentile  compared 
with  national  norms)  may  be  at  risk  of  failure  in  reading.  Average  scores  (40th  to  60th 
percentile)  are  predictive  of  satisfactory  performance  in  school  subjects  which  rely  on 
reading  skills.  Students  who  score  above  average  (over  the  60th  percentile)  are  likely  to 
be  able  to  achieve  at  a  high  level.  In  all  analyses  of  MAT6  scores,  the  percentages  are 
based  on  the  total  number  of  eligible  students,  not  solely  those  who  took  the  test.  The 
eligible  population  includes  the  following  students:  Regular  education.  Special  Needs  in 
.1  and  .2  prototypes,  and  Bilingual  Education  in  Lau  Steps  4  and  5.  In  addition  to  the 
eligible  population,  schools  arc  encouraged  to  include  all  students  in  Bilingual  Education 
Steps  2  and  3  and  Special  Education  Prototypes  .3  and  .4  who  are  able  to  take  the  test. 


Historical  Perspective:  During  the  past  tiiree  years,  the  percentage  of  eligible  high 
school  students  scoring  at  each  of  the  proficeincy  levels  on  the  Reading  test  has  been  es- 
sentially       con- 


stant. The 

number  of  stu- 
dents scoring 
above  average  is 
about  10 

percentage 
points   less   than 
the  national 

norming  sample. 


MAT6  Reading  High  School  Level 
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Metropolitan  Achievement  Test  Reading 
High  School  Level:  Score  Ranges 


Median  Percentile  Between  SY1989-90  and  SY1991-92:  Among  the  high  school  grade  levels. 

grade   9   students   continually 


Metropolitan  Achievement  Test:  Reading 
High  School  Level  Median  Percentiles 
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scored  higher  than  national 
average  on  the  reading  test. 
The  median  performance  at 
grades  10  through  12  has  re- 
mained constant  at  the  44th, 
38th  and  41st  percentile,  re- 
spectively, for  the  past  three 
years. 
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Metropolitan  Achievement  Test  Mathematics 
High  School  Level:  Score  Ranges 

Description:  Students  who  score  below  average  (under  the  40th  percentile  compared 
with  national  norms)  may  be  at  risk  of  failure  in  mathematics.  Average  scores  (40th  to 
60th  percentile)  are  predictive  of  satisfactory  performance  in  mathematics.  Students  who 
score  above  average  (over  the  60th  percentile)  are  likely  to  be  able  to  achieve  at  a  high 
level.  In  all  analyses  of  MAT6  scores,  the  percentages  are  based  on  the  total  number  of 
eligible  students,  not  solely  those  who  took  the  test.  The  eligible  population  includes  the 
following  students:  Regular  education.  Special  Needs  in  .1  and  .2  prototypes,  and  Bilin- 
gual Education  in  Lau  Steps  4  and  5.  In  addition  to  the  eligible  population,  schools  are 
encouraged  to  include  all  students  in  Bilingual  Education  Steps  2  and  3  and  Special 
Education  Prototypes  .3  and  .4  who  are  able  to  taJce  the  test.. 


Historical  Perspective:    Systemwide,  during  the  past  three  years,  the  percentage  of  eli- 
gible students  scoring  below  average  on  the  Metropolitan  Achievement  Test  in  mathe- 
matics has  steadUy  decreased  from  36%  for  SY1989-90  to  33%  for  SY1991-92.  This 
most  recent  percentage  is  seven   points  lower  than  the  national  norming  sample  (40%). 
There    were    es- 
sentially no 
changes    in    the 
percentage        of 
students    in    the 
other  two  profi- 
ciency ranges. 
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Metropolitan  Achievement  Test  Mathematics 

High  School  Level:  Score  Ranges 


Median  Percentile  Between  SY1989-90  and  SY1991-92:    During  the  past  three  years,  the 

mathematics   median   percen- 


Metropolitan  Achievement  Test:  Math 
High  School  Level  Median  Percentiles 
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tile  for  grades  9  through  1 1 
has  remained  nearly  stable,  at 
or  slighdy  below  the  national 
average.  Diuing  this  period. 
grade  12  students  have  steadi- 
ly increased  from  the  45th 
percentile  in  SY 1989-90  to 
the  51st  percentile  in 
SY1991-92. 
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Student  Performance  in  Perspective 


Comparison  of  Boston  and  Other  Cities  on  the  Metropolitan 
Achievement  Test 

Most  large  city  school  systems  have  standardized  testing  programs,  though  they  vary 
somewhat  in  the  grades  tested  and  the  tests  employed.  Using  as  a  source  the  1990-1991 
data  presented  in  National  Urban  Education  Goals:  Baseline  Indicators,  1990-91  (The 
Council  of  the  Great  City  Schools,  September,  1992),  Boston's  results  for  1990-1991  can 
be  compared  to  those  of  other  large  cities.  Data  are  shown  in  three  categories:  the  per- 
centage of  students  scoring  in  the  bottom  quarter  (with  respect  to  national  norms);  the 
percentage  of  students  scoring  in  the  top  quarter;  and  the  percentage  of  students  scoring 
above  the  national  average  (50th  percentile).' 

Most  of  the  Great  City  Schools  districts  use  tests  other  than  the  Metropolitan  Achieve- 
ment Test  (MAT6)  which  is  used  in  Boston.  However,  three  districts  (New  York,  Hous- 
ton, and  Long  Beach)  do  use  the  MAT6,  though  in  different  grades  from  Boston.  In 
order  to  make  the  comparisons  shown  below,  Boston's  data  have  been  recalculated  to 
show  exacUy  the  same  grades  as  those  used  in  the  other  cities. 

Long  Beach 

Students  in  grades  2,  4,  7,  9  and  11  are  compared  on  both  Reading  and  Mathematics. 
The  performance  of  Boston  students  is  substantially  better  on  all  three  indices;  the  differ- 
ences are  especially  large  for  Reading. 

Houston 

Students  in  grades  1  through  9  are  compared  on  both  Reading  and  Mathematics.  Again, 

the  comparisons  all  favor  Boston  students,  and  the  differences  are  larger  for  Reading  than 

for  Mathematics.^ 

'  There  is  slight  difference  in  how  the  Boston  assigned  students  to  the  "Bottom  Quarter".  Boston  included  per- 
centile scores  of  1-24  in  the  lowest  group,  while  the  GCS  included  percentiles  1  through  25.  Boston  included 
percentiles  from  50-99  as  "Above  National  Norm"  while  GCS  included  percentiles  51-99.  Both  Boston  and 
GCS  included  percentiles  of  76-99  in  the  'Top  Quarter. "  The  impact  of  this  difference  is  relatively  small. 

'  Houston  students  in  grades  1-6  who  are  instructed  in  Spanish  take  the  Spanish  Assessment  of  Basic  Education 
norm  referenced  test  instead  of  the  MAT6;  their  results  are  combined  with  those  of  the  MAT6.  There  were 
8079  students  who  took  the  SABE  in  1991;  this  constitutes  a  small  proportion  of  Houston's  total  test  scores. 
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Student  Performance  in  Perspective 


New  York  City 

New  York  uses  the  MAT6  for  Mathematics  only,  in  grades  1-8.  The  comparison  indi- 
cates that  Boston  has  a  smaller  proportion  of  students  in  the  lowest  category  of  perform- 
ance, but  also  a  smaller  proportion  in  the  highest  category  (above  75th  percentile).  The 
proportions  of  students  scoring  above  the  national  norm  are  almost  identical. 
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School  Involvement 
Practices 
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special  Education  Prototype  Increase 


Description:  A  student's  prototype  is  increased  if  he  or  she  is  moved  into  a  more  restric- 
tive or  separate  educational  setting;  the  student  spends  less  time  (if  any)  in  regular  educa- 
tion. This  definition  also  includes  students  who  move  from  regular  education  into 
Special  Education.  Prototype  increases,  while  sometimes  necessary,  are  contrary  to  Spe- 
cial Education's  overall  goal,  which  is  to  mainstream  students  as  much  as  possible.  Pro- 
totype increase  percentages  are  calculated  based  on  the  number  of  students  with  increases 
divided  by  the  total  number  of  the  students  with  a  Special  Education  Prototype.  It  should 
be  noted  that  certain  categories  of  Special  Needs  programs  are  less  likely  to  have  changes 
in  prototypes  than  others. 


Historical  Perspective:  Systemwide,  during  the  past  three  years,  the  percent  of  Special 
Education  students  with  prototype  increases  has  remained  around  13%  with  a  slight  de- 
crease to  12%  for  SY1991-92.  At  the  elementary  school  level  the  percent  has  decreased 
from  16%  for  SY  1989-90  to  14%  for  SY1991-92.  At  the  middle  school  level  the  percent 
has  remained 
around  12%.  At 
the  high  school 
level  the  percent 
has  remained 
around  8%. 
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special  Education  Prototype  Increase 


Change  Between  SY1990-91  and  SY1991-92:    More  than  half  of  the  elementary  schools  and 

almost  three-fourths  of  the 
high  schools  showed  improve- 
ment between  SY 1990-91  and 
SY1991-92.  This  means  that 
they  showed  decreases  in  the 
percentage  of  Special  Needs 
students  moving  into  more  re- 
strictive settings  (i.e.,  in- 
creases in  prototype). 
One-third  of  the  middle 
schools  also  showed 

improvement. 
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special  Education  Prototype  Decrease 


Description:  A  student's  prototype  is  decreased  if  he  or  she  is  moved  into  a  less  restrictive  or 
separate  educational  setting;  the  student  spends  more  time  in  regular  education.  This  definition 
also  includes  students  who  are  totally  mainstreamed  out  of  Special  Education.  Prototype  de- 
creases reflect  Special  Education's  overall  goal,  which  is  to  mainstream  students  as  much  as  pos- 
sible. Prototype  decrease  percentages  are  based  on  the  number  of  students  with  decreases 
divided  by  the  total  number  of  the  students  with  a  Special  Education  Prototype.  It  should  be 
noted  that  certain  categories  of  Special  Needs  programs  are  less  likely  to  have  changes  in  proto- 
types than  others. 


Historical  Perspective:  Systemwide,  during  the  past  three  years,  the  percent  of  Special  Educa- 
tion students  with  prototype  decreases  increased  from  18%  for  SY1989-90  to  21%  for 
SY1991-92.  All  three  levels  have  shown  a  steady  movement  of  students  from  higher  to  lower 
prototypes.  At  the  elementary  school  level  the  percent  of  downward  changes  has  increased  from 
19%  for  SY1989-90  to  23%  for  SY 199 1-92.  At  the  middle  school  level  die  percent  increased 
from  16%  for 

SY  1989-90  to  20%  for 
SY  1991 -92.  At  the  high 
school  level  the  percent 
increased  from  17%  for 
SY1989-90  to  20%  for 
SY1991-92. 


Special  Education  Prototype  Decreases 
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special  Education  Prototype  Decrease 


Change  Between  SY1990-91  and  SY1991-92:  Over  60%  of  all  schools  had  a  larger  proportion 

of  Special  Needs  students  with 
prototype  decreases  (move- 
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ments  to  a  less  restrictive  set- 
ting) in  SY1991-92  than  in 
SY1990-91. 
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special  Education  New  Referrals 


Description:  This  indicator  is  a  count  of  all  new  referrals  to  Special  Education  within  the 
school  year.  A  referral  to  Special  Education  suggests  that  the  student's  needs  could  not  be  met 
within  the  regular  education  program.  It  should  be  noted  that  prior  to  1991-1992,  the  referral  is 
attributed  to  the  last  school  the  student  attended;  from  1991-1992  on  it  is  attributed  to  the  school 
in  which  the  referral  occurred. 


Historical  Perspective:  Systemwide,  the  number  of  new  referrals  to  Special  Education  de- 
creased 11%  from  SY1989-90  to  SY1991-92.  All  diree  levels  have  shown  a  decrease  in  die  total 
number  of  new  referrals  to  Special  Education.  At  the  elementary  school  level  where  the  bulk  of 
new  referrals  come  from,  the  number  of  new  referrals  to  Special  Education  decreased  6%  from 
SY1989-90  to  SY1991- 


92.  At  the  middle 
school  level  the  number 
of  new  referrals  de- 
creased 36%  from 
SY 1989-90  to  SY1991- 
92.  At  the  high  school 
level  the  number  of  new 
referrals  decreased  19% 
from  SY  1989-90  to 
SY1991-92. 


Special  Education  New  Referrals 
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special  Education  New  Referrals 


Change  Between  SY1990-91  and  SY1991-92:   Over  half  of  all  schools  showed  improvement 

by   reducing   the   number   of 
new     referrals     to     Special 
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Bilingual  Education  Step  Increase 


Description:  A  Lau  Step  increase  is  defined  as  a  change  to  Step  3,  4,  or  5.  Students  moving  out 
of  the  Bilingual  Education  Program  altogether  (i.e.,  from  Step  5  to  regular  education)  are  not  in- 
cluded. Step  increases  reflect  the  success  of  the  program  in  moving  students  into  more  main- 
streamed  or  regular  education  classroom  settings.  Step  changes  are  determined  by  comparing 
Step  assignments  at  the  end  of  one  year  with  the  Step  assignment  at  the  end  of  the  previous  year. 
(However,  Step  increases  which  occur  after  May  15  are  credited  to  the  following  year.)  The 
percentage  is  based  on  the  number  of  students  with  Step  increases  divided  by  the  total  Bilingual 
Education  program  enrollment. 


Historical  Perspective:  Systemwide,  during  the  past  three  years,  the  percentage  of  Bilingual 
program  students  with  Lau  Step  increases  has  risen  steadily  from  15%  in  SY1989-90  to  24%  in 
SY 199 1-92.  All  three  levels  have  shown  improvement  in  the  percentage  of  Bilingual  program 
students  with  Step  increases.  At  the  elementary  school  level  the  percentage  of  students  with 
Step  increases  jumped 
from  11%  in  SYl 989-90 
to  18%  for  SY1991-92. 
At  the  middle  school 
level  the  percentage  rose 
1%  since  SY  1989-90. 
At  the  high  school  level 
the  percentage  of  stu- 
dents with  Step  in- 
creases jumped  from 
14%  in  SY1989-90  to 
33%forSY1991-92. 
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Bilingual  Education  Step  Increase 


Change  Between  SY1990-91  and  SY1991-92:   Over  80%  of 
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the  middle  and  high  schools  and 
over  50%  of  the  elementary 
schools  increased  the  propor- 
tion of  Bilingual  Education 
students  who  had  Lau  Step  in- 
creases (moved  toward  main- 
streaming)  between 
SY1990-91  and  SY1991-92. 
(This  analysis  focused  on  the 
59  schools  which  have  bilin- 
gual pro-  grams). 
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Metropolitan  Achievement  Test  Reading: 
Students  Taking  the  Test 


Description:  It  is  important  both  from  an  instructional  perspective  and  in  terms  of  school  ac- 
countability that  as  many  students  as  possible  who  are  defined  as  eligible  should  be  regularly  as- 
sessed for  their  level  of  achievement  For  the  MAT6  test,  the  eligible  population  includes  the 
following  groups  of  students:  regular  education.  Special  Needs  in  .1  and  .2  prototypes,  and  Bi- 
lingual Education  in  Lau  Steps  4  and  5.  It  is  important  to  note  that  although  the  test  scores  of 
Special  Needs  students  in  .3  and  .4  Prototypes  and  Bilingual  Education  students  in  Lau  Steps  1, 
2,  and  3  are  not  included  in  systemwide  calculations,  these  children  are  administered  the  test  if  at 
all  possible. 


Historical  Perspective:  Systemwide,  during  the  past  three  years,  the  percentage  of  eligible  stu- 
dents taking  the  Metropolitan  Achievement  Test  in  Reading  has  remained  fairly  stable  at  around 
89%  to  90%.  The  rate 
has  fluctuated  only 
about  1  percentage  point 
each  year  for  the  ele- 
mentary, middle,  and 
high  school  levels. 


MAT6  Reading  -  Students  Taking  the  Test 
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Metropolitan  Achievement  Test  Reading: 

Students  Taking  the  Test 


Change  Between  SY1990-91  and  SY1991-92:    Among  elementary  schools,  over  40% 

showed  an  increase  in 
the  proportion  of  eligi- 
ble students  taking  the 
Reading  test  between 
SY1990-91  and 
SY 1991-92.  Only 
16%  of  middle  schools 
and  27%  of  high 
schools  increased  the 
percentage  of  eligible 
students  taking  the  test 
between  the  two  years. 
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Metropolitan  Achievement  Test  Mathematics: 
Students  Taking  the  Test 


Description:  It  is  important  both  from  an  instructional  perspective  and  in  terms  of 
school  accountability  that  as  many  students  as  possible  who  arc  defined  as  eligible  should 
be  regularly  assessed  for  their  level  of  achievement.  For  the  MAT6  test,  the  eligible  pop- 
ulation includes  the  following  groups  of  students:  regular  education.  Special  Needs  in  .1 
and  .2  prototypes,  and  Bilingual  Education  in  Lau  Steps  4  and  5.  It  is  important  to  note 
that  although  the  test  scores  of  Special  Needs  students  in  .3  and  .4  Prototypes  and  Bilin- 
gual Education  students  in  Lau  Steps  1,  2,  and  3  arc  not  included  in  systemwide  calcula- 
tions, these  children  are  administered  the  test  if  at  all  possible. 


Historical  Perspective:  Systemwide,  during  the  past  three  years,  the  percentage  of  eligi- 
ble students  taking  the  Metropolitan  Achievement  Test  in  mathematics  has  remained  fair- 
ly stable  at  around  88%  to  89%.  The  rate  has  fluctuated  only  about  1  percentage  point 
each  year  for  the 
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Metropolitan  Achievement  Test  Mathematics: 

Students  Taking  the  Test 


Change  Between  SY1990-91  and  SY1991-92:  While  nearly  40%  of  the  elementary  and  middle 
schools  showed  increases  in  the  percentage  of  eligible  students  taking  the  test,  only  13%  of  high 

schools   did   so.      At   all 
three    levels,    there    were 
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more  schools  showing  de- 
creases than  increases  be- 
tween SY 1990-91  and 
SY1991-92. 


PAGE  63 


\ 
PAGE  64 


Appendix  A 


PAGE  65 


Appendix  A 


Table  1 
Supporting  Indicators  Included  in  tlie  End-of- Year-Report 

Student  Attendance 

-  Perfect  Attendance 

-  Absent  5  or  Fewer  Days 

-  Absent  Between  6-10  Days 

-  Absent  1 1  or  More  Days 

Bilingual  Education  Students 

-  In  Program  3  Years  or  Less 

-  In  Program  More  Than  3  Years 

Special  Education  New  Referrals 

-  Referred  by  School 

-  Referred  by  External  Agencies 

-  Referred  by  Parent 

-  With  Pre-Referral  Not  Waived 

Average  Staff  Attendance 

-  0  Sick  Days 

-  1  to  5  Sick  Days 

-  6  to  10  Sick  Days 

-  1 1  or  More  Sick  Days 

School   Choice 

-  Regular  Education  Students  Administratively  Assigned  After  Round  I 
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For  this  systemwide  indicators  report,  the  data  have  been  combined  in  various  ways 
which  will  be  described  below. 


Systemwide  Aggregate  Summary 

As  noted  in  the  text  of  this  report,  the  Systemwide  Aggregate  Summary  represents  an 
effort  to  combine  the  individual  indicators  into  groups  (SchoolHolding  Power/Climate, 
Student  Achievement,  and  School  Involvement  Practices)  and  to  summarize  the  findings  in 
terms  of  improvement  or  decline.  In  order  to  make  this  analysis  possible  and  the  aggregate 
graphs  interpretable,  all  of  the  indicators  had  to  be  represented  by  the  same  metric. 
Accordingly,  change  on  all  indicators,  even  those  which  were  originally  counts  (e.g., 
suspension  occurrences)  was  converted  into  percentage  change  between  SYl  990-91  and 
SY1991-92  with  SY1990-91  as  the  base  year.. 

In  addition  to  using  the  same  metric,  each  indicator  had  to  be  put  on  the  same  direction 
on  a  scale  of  "improvement"  or  "decline."  For  most  of  the  indicators,  "improvement"  is  reflected 
in  an  increase  from  one  year  to  the  next.  For  example,  if  a  school's  student  attendance  is  96%  in 
one  year  and  98%  the  next  year,  then  it  has  improved.  However,  for  several  indicators,  for 
instance,  dropouts,  "improvement"  is  represented  by  a  decrease  from  one  year  to  the  next. 
Thus,  if  a  school  had  a  14%  dropout  rate  one  year  and  a  12%  dropout  rate  in  the  next  year,  this 
decrease  represents  an  improvement  in  the  school's  performance. 

In  order  to  make  the  graphs  for  the  aggregate  summary  relatively  straightforward,  all 
changes  which  are  improvements  are  shown  as  positive  percentages.  To  do  this,  two  different 
ways  of  computing  the  changes  from  one  year  to  the  next  in  the  aggregate  data  were  used. 
Where  an  increase  is  an  improvement  in  performance,  the  number  (or  percentage)  for 
SY1990-91  is  subtracted  from  the  number  (or  percentage)  for  SY1991-1992  and  divided  by  the 
number  (or  percentage)  for  SY1990-91.  The  resulting  number  multiplied  by  1(X)  gives  the 
percentage  improvement  over  SY1990-91  which  the  school  showed  by  the  end  of  SYl  991-92. 
Where  an  improvement  in  performance  is  represented  by  a  decrease  in  the  indicator  (and 
therefore  the  SYl 991-92  number  is  expected  to  be  smaller  than  that  of  the  prior  year),  the 
SY1991-92  figure  is  subtracted  from  the  SY1990-91  figure.  The  rest  of  the  calculation  is  the 
same.  An  example  of  the  calculations  is  given  below. 

School  A:  SY1990-91  attendance,  96%;  SY1991-92  attendance,  98%.  Increases  represent 
improvement,  so  the  SY1990-91  figure  is  subtracted  from  the  SY1991-92  in  order  to  calculate 
the  percent  of  improvement  or  decline. 

(98-96)/96  =  2/96,  multiplied  by  1(X),  gives  an  improvement  of  slightly  over  2%. 

School  B:  SY1990-91  dropout,  14%;  SY1991-92  dropout,  14%.  For  dropout,  an  increase 
represents  a  decline  in  school  performance,  so  the  SYl 991 -92  figure  is  subtracted  from  the 
SYl 990-91  figure  in  order  to  calculate  the  percent  of  improvement  or  decline. 
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(12-14)/ 12  =  -2/12,  multiplied  by  100,  gives  a  decline  in  performance  (represented  by 
the  negative  number)  of  -16.7%. 

Analysis  of  Individual  Indicators 

Two  different  analyses  are  presented  for  each  of  the  19  individual  indicators.  The  first 
is  an  historical  analysis  by  school  level  (elementary,  middle,  high,  and  systemv^ide).  The 
second  is  a  comparison  of  the  percentage  of  schools  at  each  level  which  increased,  decreased,  or 
stayed  the  same  for  each  indicator  over  the  last  two  years. 

Historical  Comparisons 

For  the  historical  comparisons,  the  unit  of  analysis  was  intended  to  be  all  individual 
students  at  a  given  level.  This  would  mean  that  the  data  for  all  students  classified  as 
elementary,  for  instance,  would  be  grouped  and  counts  made  or  percentages  calculated  based 
on  all  students  at  the  particular  level.  (It  should  be  noted  that  this  is  not  the  same  as  taking  the 
values  for  each  school  and  adding  them  together  and  dividing  by  the  number  of  schools  at  a 
particular  level.)  In  some  instances,  the  actual  calculation  of  the  average  was  done  using  data 
aggregated  for  the  entire  school  but  then  'weighted'  by  the  school's  enrollment.  This  procedure 
leads  to  a  very  close  approximation  of  the  intended  analysis.  This  method  of  calculation  was 
used  with  the  Average  Daily  Student  Attendance  because  the  reports  from  which  it  was 
derived  are  only  available  for  schools  as  a  whole.  In  other  instances,  such  as  Percentage 
Promoted,  the  data  had  already  been  aggregated  by  school  and  the  weighting  procedure  was  a 
straightforward  approach.  For  Staff  Attendance,  school  level  data  were  weighted  by  the 
number  of  staff  at  each  school. 

Another  issue  was  the  analysis  of  data  from  schools  with  grades  at  more  than  one 
school  level,  for  instance  the  Hernandez  with  grades  K-8,  or  Boston  Latin  Academy,  with 
grades  7-12.  Depending  on  the  format  of  the  data,  one  of  two  different  procedures  was  used  to 
assign  the  school's  data  to  a  school  level.  For  those  indicators  for  which  data  were  available  by 
school  ID  (as  noted  in  the  table  at  the  beginning  of  this  technical  discussion),  each  school  was 
assigned  a  level  based  on  its  predominant  grades.  Specifically,  schools  with  an  elementary 
school  number  (such  as  the  Tobin  and  the  Hernandez)  had  their  data  included  at  the 
elementary  level,  and  schools  with  a  high  school  number  (such  as  Boston  Latin  School  and 
Boston  Latin  Academy),  had  their  data  counted  with  the  high  schools.  However,  some 
indicators  (as  shown  on  the  table,  e.g..  Dropouts  and  Percentage  Promoted)  were  available 
separately  by  grade.  For  these  seven  indicators,  the  data  for  students  in  multi-level  schools 
were  counted  at  their  appropriate  level.  For  example,  dropout  data  for  grades  6-8  in  Boston 
Latin  Academy  were  included  in  the  middle  school  analyses,  and  the  data  for  grades  9-12  were 
applied  to  the  high  school  analyses. 

Metropolitan  Achievement  Test 

For  the  MAT6  scores,  students  are  grouped  into  one  of  3  categories:  below  average, 
average,  and  above  average.  The  percentage  is  determined  by  dividing  that  number  by  the 
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total  number  of  eligible  students  in  the  school.  Thus,  since  not  all  eligible  students  take  the 
test,  the  total  percent  of  the  three  groups  is  always  less  than  100%. 

Changes  in  Schools 

In  these  analyses,  for  each  indicator  the  data  for  each  school  in  SYl  990-91  was 
compared  with  the  data  for  the  school  in  SY1991-92.  If  the  percentage  (or  count,  depending  on 
which  indicator  was  being  considered)  was  bigger  in  SY1991-92  than  in  SY1990-91,  the  school 
weis  counted  among  those  that  increcised.  If  the  percentage  or  count  was  smaller  in  SY  1991-92 
than  in  SYl 990-91,  the  school  was  counted  among  those  that  decreased.  For  data  which  were 
percentages  (e.g.,  Promotior\s),  the  differences  were  calculated  to  one  decimal  point  and  then 
rounded  to  a  whole  point.  For  example,  if  a  school's  promotion  rate  in  the  earlier  year  was 
96.3%  and  in  the  second  year  it  was  96.6%,  the  increase  (0.3)  would  be  less  than  one-half  a 
percentage  point  and  therefore  rounded  down  to  zero.  Had  the  second  year's  rate  been  96.9%, 
with  a  difference  of  0.6,  the  difference  would  have  been  rounded  up  to  one  and  the  school 
counted  as  having  increased  in  promotion  rate.  After  the  classification  of  each  school's  data, 
the  percentage  of  schools  at  each  level  which  showed  an  increase,  stayed  the  same,  or 
decreased  was  calculated. 

Schools  were  included  in  the  analysis  only  if  they  had  complete  data  for  both  years.  For 
most  of  the  analyses,  there  were  71  elementary  schools,  19  middle  schools,  and  15  high  schools. 
Exceptions,  such  as  Bilingual  Education  Step  Increase,  are  noted  in  the  text. 

Each  school  was  counted  only  once,  even  if  it  had  students  at  more  than  one  grade 
level.  A  school  was  assigned  to  the  level  where  it  had  the  most  students.  Thus,  the  Hernandez 
and  Tobin  were  counted  with  elementary  schools,  and  Boston  Latin  School  and  Boston  Latin 
Academy  were  counted  with  high  schools.  For  the  School  Choice  data,  the  first  choices  for 
grade  1  and  grade  6  for  the  Tobin  and  Hernandez  schools  were  combined  to  get  a  total  for  the 
school.  For  dropout  data,  since  dropout  is  not  counted  among  elementary  school  students,  the 
data  for  the  6th-8th  graders  in  the  Tobin  and  the  Hernandez  were  counted  as  if  the  schools 
were  middle  schools.  However,  dropout  data  for  all  grades  in  Boston  Latin  School  and  Boston 
Latin  Academy  were  applied  to  the  high  school  analysis. 


Schools  Included  and  Excluded  from  the  Analyses 

For  the  Systemwide  Aggregate  data  and  the  Historical  Comparisons,  schools  were 
included  in  an  analysis  in  any  year  in  which  they  existed.  For  example,  the  Holmes 
Elementary  School  was  included,  even  though  it  did  not  open  until  SYl 991 -92.  This  procedure 
was  appropriate  in  order  to  account  for  all  the  included  students  who  were  in  the  system  in 
any  given  year.  The  procedure  necessarily  differed  for  the  School  Change  analyses,  since  a 
school  had  to  have  data  for  two  years  in  order  to  be  included. 

In  developing  all  three  analyses,  certain  special  programs  and  schools  were  not 

included  in  the  calculations.  These  include  the  Horace  Mann  SchooL  the  McKinley  Schools,  the 

\ 
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Carter  School,  the  Science/Tech  Program  (for  middle  school  students),  Boston  Prep,  and 
Another  Course  to  College. 
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